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Abstract 


The  probabilistic  evolution  of  random  walk  on  the  circle  Is  studied 
and  the  results  used  to  derive  a MAP  sequence  estimator  for  phase.  The 
sequence  estimator  is  a Vlterbl  tracker  for  tracking  phase  on  a flnlte- 
dlmenslonal  grid  In  The  algorithm  is  shown  to  provide  a conven- 

ient method  for  obtaining  fixed-lag  phase  sequence  estimates.  Performance 
characteristics  are  presented  and  compared  with  several  other  nonlinear 
filtering  algorithms.  The  results  Indicate  superior  performance  over  the 
range  of  parameter  values  usually  considered  and  excellent  performance  In 
parameter  ranges  corresponding  to  high  slgnal-to-noise  ratio  and  rapidly 
fluctuating  phase.  Applications  to  coherent  data  communication  systems 


are  outlined. 


1.  Introduction 


Phase  tracking  is  the  classic  nonlinear  filtering  problem.  It 
arises  In  narrowband  analog  communication,  data  transmission,  and  spread 
spectrum  communication.  As  usually  stated,  the  problem  is  to  obtain  a 
causal  estimate  of  the  phase  based  on  noisy,  phase -modulated  observations. 
The  best  known  solutions  are  phase  locked  loops.  In  data  transmission  a 
fixed-lag  delay  in  the  estimate  may  be  acceptable,  especially  if  the  delay 
offers  significant  performance  Improvement. 

In  any  truly  nonlinear  filtering  approach  to  optimum  phase  tracking, 
the  basic  problem  Is  to  propagate  the  a poetet'ioi'i  density  of  the  phase, 
conditioned  on  an  increasing  measurement  record,  much  as  is  done  in 
Kalman  filtering.  Unfortunately,  there  exist  no  finite-dimensional 
schemes  for  propagating  the  exact  conditional  density  or  for  propagating 
a f Inite-dimensional  sufficient  statistic.  One  must  approxlnuite. 

There  are  many  approaches  available  for  propagating  an  approxlnuite 
conditional  density  or  an  approximate  sufficient  statistic.  One  may  use 
the  maximum  a poaterioj^i  (MAI’)  Interval  estimation  equations  of  Lehan 
and  Parks  [I]  and  Youla  (2]  to  obtain  a set  of  differential  equations 
satisfied  by  the  noncausal  MAP  Interval  estiuu,te.  The  boundary  condi- 
tions are  two-point  boundary  conditions.  Causal  approximations  may  be 
obtained  using  the  invariant -imbedding  technique  of  Bellman  13].  This 
approach  has  been  used  by  Detchmendy  and  Srldhar  14]  and  Baggeroer  [31. 

As  Van  Trees  (6]  points  out  in  his  discussion  of  this  approach,  the  re- 
quired approximations  are  linearizing  approximations.  Another  alternative 
is  to  begin  with  the  differential  equations  of  Kushner  {7]  that  describe 
the  evolution  of  the  a poatt:viot'i  density  of  M.irkov  processes.  The  re- 
sulting equations  can  only  be  solved  approximately  in  the  case  of  phase 


I 

i 


2 


modulation.  Snyder  (8]  has  used  this  approach  to  obtain  phase  locked 
loop  (PLL)  type  trackers.  Willsky  (9)  has  used  it  to  obtain  propagation 
equations  for  the  Fourier  series  coefficients  that  characterize  the 
periodic  ii  density  for  the  phase.  A third  approach  Is  to 

pose  the  phase  estim.itlon  problem  as  a state  estimation  problem  involv- 
ing state  variables  that  are  functionally  dependent  on  the  phase.  These 
state  equations  are  differentiated  according  to  the  Ito  rule  to  obtain 
dynamical  state  equations  with  state-depeitdent  noise.  Using  this  approach 
Bucy  and  Malllnckrodt  (10]  have  obtained  differential  equations  for  the 
conditional  density  of  the  state  and  for  the  conditional  expectation  of 
the  state.  Taking  this  approach  one  step  further,  Ovistafson  and  Speyer 
111]  have  obtained  an  explicit  realizable  filtering  structure  by  imposing 
the  constraint  that  the  filter  be  of  the  Kalman  filter  variety.  The 
Kalman  gain  is  optimized  and  the  resulting  "linear  quadrature"  filter 
(LQF),  a fancy  PLL,  is  shown  to  outperform  the  classical  FLL  and  to  per- 
form almost  as  well  as  Willsky's  Fovirler  coefficient  filter  (FCF)  (9]. 

All  of  the  approaches  outlined  above  are  continuous-time  in  nature, 
although  many  of  them  have  been  simulated  in  discrete-time. 

The  fundamental  difficulty  of  nonlinear  filtering  in  discrete-time 
remains  one  of  propagating  an  a filtering  density,  conditioned 

on  an  increasing  measurement  seqvience.  Tlte  governing  equatli’ns  are  tl>e 
so-called  Bayesian  recursions.  These  equations  are  easy  to  write  down 
but  difficult  to  solve.  There  is  no  finite-dimensional  algorltlim  for 
propagating  the  <z  l'o&tcinoi*i  density  or  a finite-dimensional  sufficient 
statistic.  The  simplest  approach  is  to  assume  the  a {'Otttt'rf i'l't  density 
la  normal  and  then  to  recursively  compute  a conditional  nK'an  and  covari- 
ance along  the  lines  of  extended  Kalman  filtering.  Kelly  and  tJupta  |12] 
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have  used  this  approach  to  obtain  digital  PLLs.  More  sophisticated 
approaches  Involve  sharper  approximations  to  the  a posteirioin  density. 
Bucy  and  Malllnckrodt  [10]  have  derived  an  up-date  formula  for  the  dis- 
crete-time cyclic  density  that  describes  the  a poeteriori  dc  .islty  of 
the  phase.  This  formula  has  been  used  to  propagate  probability  mass  on 
a flnlte-dlroensional  grid  and  obtain  their  so-called  point-mass  filter 
(PMF) . Bucy  and  Youssef  [13]  have  expanded  the  cyclic  density  of  [10] 
in  a Fourier  series  and  propagated  a finite  number  of  the  coefficients. 
The  advantage  of  this  method  over  the  point  mass  method  is  that  computa- 
tion times  are  reduced  by  a factor  of  8 [13].  V\'lllsky  [9]  has  also 
expanded  a periodic  a posteriori  density  in  Fourier  series  coefficients 
and  propagated  these  coefficients  according  to  a multiplicative  rule 
that  Is  related  to  the  Chapman-Kolmogorov  convolution  that  must  be  per- 
formed In  the  Bayesian  recursions.  A third  approach  Is  to  expand  the 
a posteriori  density  of  In-phase  and  quadrature  state  variables  using 
the  Gaussian  sum  formula  (GSF)  of  Sorenson  and  Alspach  [14].  The  mean 
and  covariance  of  the  Individual  terms  in  the  sum  are  then  propagated 
as  new  measurements  are  obtained.  This  approach  has  been  used  by  Tam 
and  Moore  [15]  to  obtain  a phase  tracker  that  performs  about  as  well  as 
Bucy  and  Malllnckrodt ’s  point  mass  filter. 

In  this  paper  we  propose  an  approach  to  phase  soipnenoc  estimation 
(emphasis  on  the  word  sequence)  that  has  Its  logical  antecedents  in  the 
filtering  philosophy  of  Youla  [2]  and  whe  data  decoding  nhllosophy  of 
Vlterbl  [16].  We  pose  a MAP  sequence  estimation  problem  that  leads  to 
nonlinear  MAP  equations  not  unlike  the  continuous- time  MAP  interval 
equations.  Fortunately  there  exists  a dynamic  programming  algorithm  to 
efficiently  solve  for  survivor  phase  sequences  that  approximate  the 
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desired  MAP  sequence.  The  .“ilgorlthin  provides  a handy  mechanism  for  gener- 
ating fixed-lag  phase  estimates  that  are  superior  to  other  knowi^  estinbttes. 

As  is  common  in  nu'st  of  the  current  commvin  teat  Ions  literature  we  call  our 
dynamic  prograimnlng  algorithm  a Vlterbi  algorithm. 

Calm  (171  has  suggested  that  phase  may  he  tracked  with  delay  In  ' 

i 

i 

order  to  extend  the  so-called  thn'shold.  He  proposes  a Vlterhl-like 
algorithm  for  tracking  carrier  phase  sequences  whose  real izat iitns  satisfy 
dynamics  constraints.  There  is  certainly  a philosophical  link  between 
Cahn's  work  and  ours,  but  the  approaches  are  really  quite  different. 

I'ngerboeck  (18]  has  proposed  an  algorithm  for  phase  tracking  that  makes 
use  of  a delta-modulation  approximation  to  the  phase  sequence  and  an 
approximate  version  of  the  Vlterbi  algorithm.  Ungerboeck's  modelling 
assumptions  and  algorithm  development  are  also  very  different  from  ours. 

An  outline  for  this  paper  goes  as  lollows.  The  b.'isic  ph.ase 
tracking  problem  is  posed  In  Section  IT.  In  Sections  III-V  a tractable 
nu'del  for  random  phase  Is  developed.  The  development  begins  with  a 
discussion  of  random  walk  on  the  circle  as  a model  for  phase  noise.  Ai\ 
approximating  process  Is  then  specified  that  nuikes  Markov  transitions 
at  periodic  sampl  l»\g  instants  and  rctmilns  constant  vm  intervals  between 
samples.  The  probabilistic  evolution  of  the  approximating  process  Is 
completely  characterized  by  a folded  nornual  conditional  density.  In 
Section  VI  these  approxiimitions  are  used  to  write  the  (olnt  density 
function  of  the  data  and  the  phase  as  a finite-dimensional  deitslty. 

The  sequence  of  en> elope  and  phase  statistics  computed  on  contiguous 
intervals  arises  a^  a f inlte-dlmens lonal  sufficient  statistic.  These 
results  are  used  In  Section  Vll  to  restate  the  phase  tracking  problem 
In  discrete-time.  The  MiVP  phase  sequence  estimation  problem  Is  posed 
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in  Section  VIII  iiud  several  inlerestlnt;  properties  of  the  MAP  sequence 
are  derived  In  Section  IX.  The  solution  for  the  cvuistant  phase  acquisi- 
tion case  is  derived  In  Section  X,  where  it  Is  shown  that  the  est Inuitor  is 
moduIo-Jn  unbiased.  In  Section  XI  the  phase  space  l-n.n)  Is  dlsi-reii^ed  to  a 
f Inite-dlroenslonal  ftrld,  a path-metric  is  Identified,  and  a Vlterbl 
algorithm  is  derived  to  efficiently  keep  track  of  survivor  sequences  that 
can  potentially  become  approxlmants  to  the  MAP  sequence.  Fixed-lag  (or 
fixed  depth  constant)  versions  of  the  Viterbl  algorithm  for  obtaining 
fixed  lag  estimates  of  phase  are  discussed.  The  envelope  and  phase 
statistics,  and  the  folded  normal  density  of  Section  IV,  enter  the  path 
metric  in  an  interesting  way.  Illustrative  simulations  are  presented  .ind 
annotated  in  Section  XII.  The  performance  characteristics  of  phase  locked 
loops  and  related  Kalman  filters  are  summarized  in  Section  XIII  and  used 
to  bound  the  performance  of  random  phase  trackers.  In  Section  XIV  Monte- 
Carlo  performance  results  are  presented  and  compared  with  published  per- 
formance results  for  a variety  of  nonlinear  filtering  algorithms.  The 
results  show  the  Viterbi  algorithm  to  be  clearly  sviperlor  to  other 
algorithms  both  in  performance  coropiitation  speed  foi  appl  Icat  Ions  in 
which  moderate  delays  may  be  tolerated.  Applications  to  coherent  communi- 
cation are  outlined  in  Sect  li>n  XV  and  concluding  renutrks  are  advanced  In 


Section  XVI. 
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II.  The  Basic  Problem 

Consider  Che  randomly  phase  modulated  signal 

X(t)  » cos[2TtfQt  + 4>(t)l  , t ^ 0 (1) 

The  frequency  Is  the  carrier  frequency  and  ^(t)  Is  a random  phase 
process.  The  signal  Is  observed  in  additive  noise  to  produce 
the  observation  process 

Z(t)  - X(t)  + N(t)  , t 0 (2) 

Our  convention  will  be  that  upper  case  letters  denote  random  processes 
and  random  variables,  and  that  lower  case  letters  denote  realizations 
of  these  objects.  In  our  subsequent  development  we  will  assume  N(t)  is 
white  Gaussian  noise  (WGN)  of  two-sided  spectrum  level  Nq/2.  By  this 
convention  we  mean  the  noise  power  in  a 1 Hz  band  is  N^. 

The  basic  problem  is  to  estimate  a realization  of  'J>(t),  call  it 
(>(t),  from  the  measurement  record  {z(s),  0 s < t).  Of  course  this 
measurement  record  is  simply  a realization  of  the  measurement  process 
Z(s)  on  the  interval  0 £ s < t.  The  problem  statement  may  be  relaxed 
to  allow  the  estimate  of  (|i(t)  to  be  a fixed-lag  estimate,  in  which  case 
the  estimate  may  be  based  on  the  measurement  record  {z(s),  0 ^ s < t + x}. 

The  approximations  of  Sections  III-V  will  permit  us  to  replace  this 
continuous- time  problem  statement  with  the  following  discrete-time 
problem  statement.  Let  Z^^  denote  the  complex  observation  sequence 

Zj^  - e *'  + , k = 1,2,...  (3) 

where  ••  discrete-time  phase  sequence  and  is  an  additive 

noise  sequence  of  independent  Identically  distributed  normal  random 
variables.  The  problem  is  to  estimate  a realization  of  call  it  4>j^, 
from  the  measurement  record  i“l,2, . . . .k+k^}.  The  parameter  k^  is 


th*  fixed  lag.  Note  that  in  this  discrete-time  statement  the  problem  has 
been  converted  to  a baseband  problem  in  which  the  carrier  frequency  no 
longer  enters  explicitly.  In  Section  VII  we  establish  a connection  be- 
tween the  continuous-  and  discrete-time  models  of  (1)  and  (3). 

Ue  make  the  obvious,  but  important,  observation  that  the  signal 
models  of  (I)  and  (3)  are  both  invariant  to  modulo-2ir  transformations  on 


III.  Random  Walk  on  the  Circle  as  a Model  for  Phase  Noise 


The  first,  seemingly  natural,  choice  for  a random  phase  model  is  the 

2 

Wiener  process  W(t)  with  incremental  variance  o^.  This  is  the  model  most 
commonly  used  as  a random  phase  acquisition  model.  Most  of  the  results 
in  this  paper  may  be  obtained  in  a formal  way  using  this  phase  model,  but 
certain  technical  difficulties  arise.  First,  there  is  no  stationary  dis- 
tribution in  this  model  and,  second,  there  is  no  rigorous  way  of  defining 
a unique  conditional  probability  for  transitions  from  a modulo-2iT  value 
of  ())(t)  to  another  modulo-2ir  value  at  a later  time  t + t.  The  latter 
difficulty  is  particularly  troublesome  as  one  of  the  crucial  parts  of 
our  modulo-2Tr  phase  sequence  estimator  is  a transition  probability  matrix 
that  characterizes  phase  transitions  between  modulo-2ir  values.  By  model- 
ing phase  as  a random  walk  on  the  circle  we  avoid  these  technical  diffi- 
culties. Other  authors  have  noted  that  the  circle  is  the  appropriate 
domain  on  which  to  study  modulo-2iT  type  sequences.  See  for  example  [9]. 
Let  $(t)  be  a random  walk  on  the  circle,  taking  values  in  [-11,11). 

Denote  by  the  function  p(4i  /([>  ) the  conditional  density  of  a transition 

c s 

from  the  value  <l>(s)  = (p^  at  time  s to  the  value  4>(t)  = (Ji^  at  time  t ^ s. 
This  conditional  density  satisfies  the  partial  differential  equation  [19] 


d(p 


(4) 


2 

where  Oq  is  the  inflnitesslmal  variance.  This  equation  holds  in  the 
strip  -IT  < (}>  < It,  t > s,  for  any  fixed  -it  ^ iji  £ ’'f-  The  boundary 

conditions^  are 

^We  are  using  the  convention  that  ♦(t)  denotes  a random  variable  and  41^ 
a realization.  When  the  context  is  clear,  and  no  danger  of  confusion 
exists,  we  will  sometimes  make  no  distinction  in  notation  between  a 
random  variable  and  its  realizations.  The  same  cautionary  note  holds 
for  the  discrete-time  random  variables  and  the  realizations  4)^. 
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llm  ; *(•)  : Dirac  delta 

L 8 C 8 

P('('j  - -n/'I'jj)  - pC-fj.  " ’'/4'jj) 

4-pU^  - 

t 

A Laplace  tranaform  typo  solution  for  pC'^^./'l'^)  is 


^ -■  i'  ‘‘xpi 2~ (4*  -<•  -n2n)^) 

2,  V n-->”  2u  (t-s) 

2no^^(t-8)  0 


It  la  oaally  aeon  that  the  process  ♦(t)  la  conditionally  approximately 

N(4  ,iu(t-s)),  Klvon  *(8)  - 4 for  small  (t-s).  An  eigenfunction 
8 0 8 

expansion  of  the  following  form  Is  also  useful: 

p(4>  /4'^)  " 2'„  ^ oxp(-n^o‘t/2)oxp(ln  (4^-4'^))  ' 

n--." 


From  this  expressl«in  t:  Is  clear  th.il  I'll)  heci'mes  unltormly  dis- 
tributed as  t ‘ K.qu.it  Ion  (7)  has  also  been  noted  in  19]. 
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IV . Probabilistic  Evolution  of  tt>e  Sampled-Data  Phaao  Sei^utfnco 
Consider  the  discrete-time  sequence  obtained  by  aampliuH  ♦(!) 


at  the  periodic  sampling  instants  t ■■  kT,  k ~ 0,1,.. 


Call  a 


realization  of  The  transition  density  from  obtained 

from  (6): 

CO 

p('<'k''\_i>  “ — ~ — ^ — y*  ^'^k“'^k-i  " 

»C  2_  n**-*’  2o  T 

2ito  T o 

o 

By  the  Markov  property  of  ♦(t)  It  follows  that  f«*  « Miirkov  sequence 

for  which  the  Joint  distribution  of  "''*y  written 

K 

k-l 

I'D 

PV-I-i/vq)  = Ul-n,n) 

The  notation  P(<>^/<J|q)  : 0(~’'.’')  Indicates  ♦j  is  uniformly  distributed 
on  l“H,n).  Other  I'holces  are  admlssable:  fi'r  example  pl'l'j/'fj^l  “ 
with  knowit,  corresponding  to  a knowi\  initial  phase. 

Neglecting  some  sticky  qtiestlons  of  rigor  i>ne  nviy  obtain  the  same 
discrete-time  model  for  hv  considering  to  be  a mi'dulo-2ii  version 

of  the  following  discrete-time  random  walk: 

- '>k-i  ♦ "k  • Mi“. ■ 


“k  • 


The  nK>dulo-2n  version  of  call  It  0^^,  imiy  be  written 


"k  “ "k  ’ \ “ "k-l  \ 


Given  0|^_j  “ •'<“"1"'"  variable  0^  Is  ,o‘) . As  Is  a 

modulo-2n  version  of  0^  (t  follows  that  the  conditional  density  of  0^^ , 
given  j f‘’l‘lt'il  nornwtl  density  of  (8).  For  this  reason 
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we  will  often  call  the  discrete-time  process  on  the  circle,  a 

modulo-2n  version  of  the  discrete-time  random  walk  {G,  ). 

k 

In  Section  XI  we  discretize  the  phase  space  [-n,n)  to  phase  values 

C , m“0,...,  M-1  with  M odd.  It  is  then  necessary  to  characterize  the 
n 

2 

transition  probability  from  C.  to  C for  all  M pairs  of  (t».C  ).  We 

Cm  Cm 

choose  for  our  definition  of  this  transition  probability 

with  b^  selected  so  that 
M-1 

E 1 - C.)  - 1,  1 - 0.1 M-1  (13) 

The  sum  on  n In  (8)  must,  of  course,  be  truncated.  This  truncation 
may  be  selected  to  give  the  desired  accuracy  before  the  algorithm  of 
Section  XI  is  run. 

There  is  an  important  symmetry  property  of  (12).  If  the  are 
equally  spaced  points  on  [-if, it),  for  example  “ t2iT/M  - (M-1)it/M,  the 
function  p depends  only  on  Thus  if  the  values  of  (12)  are 

organized  into  an  MxM  matrix  of  transition  probabllties,  the  matrix  has 
Toeplitz  symmetry  with  each  successive  row  a one-position  cyclic  permuta- 
tion of  the  previous  row.  We  may  compute  the  M-dimenslonal  vector 

Q “ ^^o’^l”  " ’^M-1^  ’ ^n  “ " ^O'^‘^k-1  " ^n^  obtain  any 

value  of  p('>j^  ■ ^m^^^k  I " % with  n “ |m-!.|.  In  this  way  only 

an  M-vector  of  transition  probabilities  need  be  stored  for  cyclic  read- 
ing. 


: 1 
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V.  An  Approximating  20H  Process 

Shown  in  Figure  1 is  a conceptual  sketch  of  the  process  ♦(t)  and 
a zero-order  hold  (ZOH)  approximation  that  is  constant  and  equal  to 
*k  " Interval  kT  ^ t < (k+l)T  between  sampling  instants. 

It  is  noted  that  for  small  T the  ZOH  process  will  approximate  ^(t).  This 
heuristic  observation  is  made  precise  by  the  following  calculations. 

Without  loss  of  generality  consider  the  interval  0 ^ t < T.  The 
probability  that  'l>(t)  differs  from  a given  value  of  *(0)  « by  6 or  more  on 
this  T second  interval  is 

P[{  sup  l4'(s)-(J>_l  ^ 6}]  (14) 

0£s<T  ^ 

This  probability  may  be  written  [20] 

P[-l  - exp(-  -V)'!':  (>5) 

_L 

Make  the  change  of  variable  x “ 6t  /Oq  to  obtain 

P[-l  - 4Q(5/.^)  (16) 

where  Q(x)  is  the  Q-f unction: 

00 

Q(x)  - / — exp(-6^)d6  (17) 

X 

The  interpretation  is  that  P[*]  is  four  times  the  probability  that  a 
2 

N(0,OqT)  random  variable  exceeds  the  value  6.  The  result  of  (16)  is 
twice  the  result  one  obtains  by  simply  computing  the  probability  that 
the  terminal  random  variable  ♦(T)  differs  from  (t>Q  by  6 or  more.  The  factor 
of  2 takes  care  of  trajectories  that  exceed  the  ±6-band  around  for 
some  0 t < T and  then  wander  back  toward  to  be  within  i6  at  t " T. 


i 

I 

r 

I 


The  reflection  principle  says  every  such  path  has  a reflection  counter- 
part that  stays  outside  ±5  at  t ■ T.  This  takes  care  of  the  factor  of  2. 
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The  importance  of  (16)  la  that  IC  allowa  ua  to  aclect  triplea 

auch  that  the  ZOH  pruceaa  approximates  4(c)  In  a well-defined 
way.  For  processes  with  large  inf initessimal  variance,  small  values  of 
T are  required  to  keep  the  ZOH  approximation  close  to  ♦(t)  with  high 
probability. 

Finally,  note  that  the  results  obtained  here  go  through  unchanged 
if  we  select  our  ZOH  approximation  to  match  the  process  4(t)  at  the  right 
end-point  of  an  interval,  rather  than  the  left  end-point.  Such  an  approxi- 
mation is  illustrated  in  Figure  1.  With  this  choice  the  process  is 
approximated  on  the  interval  (k-l)T  < t kT  by  the  value  4^^  - 4(t*kT), 
rather  Chan  by  4^^  This  simplifies  notation  a bit,  so  we  will  assume 
this  kind  of  ZOH  approximation  in  the  remainder  of  the  paper. 


14 


VI.  Joint  Penalty  Function  of  the  Data  and  the  Phaae 
Recall  the  measurement  model  of  (1).  Let  Z(t;k)  denote  the  measure- 
ment process  Z(t)  on  the  Interval  (k-1)  t ^ kT,  and  z(t;k)  a correspond 
ing  realization.  The  process  Z(t)  may  be  represented  or.  the  interval 

0 < t ^ KT  as  {Z(t;k)}^.  Let  denote  the  discrete-time  phase 

2 

sequence  that  characterizes  ♦(!)  on  the  same  Interval  . Consider  the 

following  likelihood  function  for  {Z(t;k))^  and 

and 

k 1 


fQ({z(t;k) }^) 


(18) 


The  densities  and  have  only  formal  meaning:  Is 

the  conditional  density  for  the  observation  process  Z(t),  0 < t ^ KT, 
given  the  phase  realization  k"l,2,...,K;  fp{*/*)  is  the  condi- 

tional density  for  Z(t),  0 < t ^ KT,  given  only  noise  in  the  measurement. 
From  this  interpretation  it  is  clear  that  f /* ) /fgC*  / * ) is  a likeli- 
hood ratio. 

Using  any  one  of  a number  of  standard  tricks  [21]  we  may  write  the 
likelihood  ratio  part  of  (18)  as  follows: 


f j^({z(t;k)  }^) 

fQ({z(t;k)}^) 


(19) 


■ exp{- 


K 

2Nq/t 


2 

ZNq/t 


K 

Z 

k-1 


2 

T 


kT 

/ z(t;k)co8(2Tif„t+(>,  )dt } 

(k-l)T 


2 

Recall  the  sense  of  the  characterization:  ♦(!)  is  assumed  to  be  well- 
modelled  by  the  constant  value  i'|^“'>(t“kT)  on  the  Interval  (k-l)T<t^kT. 
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F' 


This  result  may  be  written 


St  ■ jlCTf  * 20t  S 'k'  ’ 


'0'  k-1 


where  the  variable  z,  Is  defined  as  follows: 

K 

2 -J2«fQt 

z.  - = / z(t)e  dt  (21) 

(k-l)T 

It  Is  easily  verified  that  the  random  variable  Zj^,  of  which  Zj^  Is  a 
realization,  Is  a complex  normal  random  variable: 

: N(0,Nq/T)  (22) 

: N(0,Nq/T)  \li\ 

The  variable  Zj^  may  be  viewed  as  the  output  of  a quadrature  demodulator 
as  Illustrated  In  Figure  2. 

Neglecting  the  data  Independent  term  of  in  (18),  we  may  write 
the  likelihood  function  as 

V Wl^ 

0 k*l  k"l 

The  complex  sequence  is  a sequence  of  sufficient  statistics.  It 

will  be  useful  In  the  sequel  to  Interpret  results  in  terms  of  the  follow- 
ing envelope  and  phase  statistics: 

- arg  c(-n,n) 


’Re(*)  denotes  "real  part  of." 
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VII.  Restatement  of  the  Basic  Problem 

The  result  of  (23)  Is  Identical  with  the  likelihood 
K K 

function  for  and  in  the  following  discrete-time  observation 


model: 


+ N, 


k «•  1,2,... 


N. 


’ N.  11  N,  V k ^ a 


: N(0,a^)  , : N(0,o^) 

Uu  J1  V»  V (k.i) 


% - ^0^^ 


(25) 


: phase  sequence  defined  by  (8) 

Subject  to  the  disclaimers  of  rigor  stated  in  Section  IV,  the  process 
may  be  thought  of  as  a modulo-2n  version  of  the  random  walk 


0, 


\-l  ^ \ 


: N(0,aj) 


2 2^ 


(26) 


li  Wj  V k ^ I 

This  means,  under  the  ZOH  approximations  stated  In  Section  V,  the 

observation  models  of  (1)  and  (25)  are  statistically  equivalent.  Thus 

we  replace  a continuous-time  problem  with  a discrete-time  one  and  con- 

K K 

aider  the  joint  density  of  and  written  now  in  terms  of  the 

2 

parameter  o^: 


1 ^ 

Dj^  - exp  { — j 2Re  Z Zj^e  ) x P 

2a  k*l  k“l 

n 


(27) 


We  may  now  restate  the  basic,  estimation  problem  as  follows:  given 


the  observation  model  of  (25),  estimate  the  realization  (Jij^  from  the 
observation  record  )l"l,2,...,k  + This  problem  is  imbedded  in 

a more  general  MAP  sequence  estimation  problem  in  Section  VIII. 

Whenever  the  discrete-time  equations  of  (25)  model  an  underlying 
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continuous- time  problem,  then  the  parametric  links  between  continuous- 
and  discrete-time  are  simply 


"n  ■ "o''' 


2 2 

% - 


(28) 


These  same  connections  have  been  used  by  other  authors,  based  on  differ- 
ent arguments.  See  for  example  [10].  We  have  been  motivated  in  our 
development  by  the  modelling  assumptions  of  Hatsell  and  Nolte  [22]. 

When  there  is  no  underlying  continuous- time  problem  the  discrete- 
time  model  of  (25)  becomes  a legitimate  model  in  its  own  right  for  dis- 
crete-time phase  tracking.  In  Section  XIV  we  actually  consider  some 

2 

parametric  choices  for  which  is  quite  large.  In  these  cases  the  ZOH 
approximation  is  not  a good  one  and  there  is  no  well-posed  underlying 
continuous- time  problem.  The  phase  tracking  results  should  simply  be 
interpreted  as  discrete-time  results  for  a problem  in  which  the  discrete- 
time  phase  Is  rapidly  fluctuating. 


VIII.  The  MAI  Sequence  Estimation  Problem 
The  Joint  density  function  of  Interest  Is  given  In  (27).  Take  the 


In  and  consider  the  followli^g  MAP  sequence  estimation  problem: 

max  r 

(♦ 

0 k-1  k-1 

n 


The  objective  fui^ction  Pj^  nuiy  be  written  In  terms  of  the  envelope  and 


phase  variables  Cj^  and  .as  follows: 


a k-1  k-1 

n 

it  Is  clear  from  the  lalier  form  that  the  M.\P  phase  sequence  will  be 
one  which  stays  reasonably  close  to  the  noisy  phase  variables  (to 
make  coa(*)  large)  while  also  maintaining  a trajectory  that  Is  a pri\n‘i’ 
reasonably  likely.  Thus  the  MAP  sequence  strikes  a balance  between  what 
the  noisy  data  s.ijis  the  phase  Is  doing  and  what  the  transition  proba- 
bilities phase  aau  do.  When  the  envelope  Cj^  Is 

large  there  Is  more  of  a tendency  to  believe  the  meas\«red  This 

curious  effect  is  explained  In  Section  XIII  where  It  is  shown  that  the 
phase  statistic  *11^  is  a modulo-2n  unbiased  estimate  of  with  a vari- 
ance that  decreases  approxlmat  el  v Inversely  with  Incre.aslng  Cj^. 


I 

I 
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IX.  Character latlcH  of  the  MAI’  Saguence 

K K 

Given  the  envelope  and  phaae  variables 
phase  sequence  obtained  by  taking  derivatives  of  and 

setting  them  to  cero: 


aik  ’’^'^k^^k-1^  ■*■  *”  *'^*k+l^*k^ 


UD 


c.  slnfiti.-^.  ) - 0,  k-1,2. 


o 


n 


The  boundary  conditions  are 
3 


(1) 


02) 


(2)  _ tn  P / V - 0 

K 


Condition  (1)  simply  reflects  the  fact  that  p(4'j/>('q)  la  uniform  on  l-s.ti). 
Condition  (2)  Is  a mathematical  convenience  that  allows  us  to  put  all 
the  equations  of  (Jl)  In  the  same  form.  Of  course  and  are 

not  ciMnputed  from  the  data  and 

Equations  (29)  are  nonlinear  equations  with  two~polnt  boimdary 
conditions.  They  are  analogous  to  the  cent Inuovis-t ime  MAP  equations 
obtained  for  phase  tr.acklng  v^n  an  interval.  Wl>ile  we  cai\not  solve  the 
equations  of  (31)  explicitly  we  can  nw»ke  some  very  interesting  observa- 
tions regarding  the  properties  of  the  MAP  phase  sequence. 

It  is  easily  verified  from  the  ci'nditional  density  of  (8)  that 


in 


133) 


Therefore  when  the  K equations  of  (31)  are  sumiwni  a«\d  the  boundary 
conditions  applied,  .ill  terms  involving  tn  P cancel.  Vie  are 
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X.  The  MAP  Sequence  for  Fixed  Phase  Acgulaltlon 
Suppose  the  underlying  phase  sequence  i®  known  to  be  a con- 

stant sequence  with  the  value  of  the  constant  uniformly-distributed  on 
(-n.irj.  In  this  case  the  MAP  sequence  estimate  is  identical  with  the 
maximum  likelihood  (ML)  estimate  of  an  unknown  phase  parameter  i|i  in  a 
complex  normal  model.  For  this  reason,  and  for  the  insight  it  gives 
into  phase  estimation,  we  include  in  the  following  paragraphs  a short 
discussion  of  constant  phase  and  envelope  detection  in  complex  normal 
models.  The  inclusion  of  unknown  envelope  (call  it  c)  generalizes  the 
discussion  while  not  Influencing  the  nature  of  the  phase  estimate. 

This  follows  from  the  fact  that  the  phase  estimate  is  uncoupled  from 
the  envelope  estimate.  The  converse  is  not  true. 

Consider  the  Joint  density  function  for  the  data  parameter- 

ized by  the  envelope  c and  the  phase 

g 

^ ^ |zj^-ce-^'*'|^}  (38) 

(2x0“)  2o  k-1 

n n 


This  may  be  written 

K 

g({z.  )^)  - d(4»,c)h({z,  }^)  expl-^  Re  ce  I z,  } (39) 

R i “ ^ 2a  k-1 

n 

where 


d(.^,c) 


1 1 1 V 2. 

— exp  i r Kc  > 

2o‘ 


(40) 


h({Zk^l)  - ‘?xp{ -j  S 

2a  k-1 
n 

It  follows  from  the  factorization  theorem  124,  p.  1151  that  the  complex 
-1 

statistic  K T Z.  is  sufficient  for  the  parameter  pair  (c,i^).  The 
k-1 
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ML  estimate  fur  the  composite  parameter  a A ce*'  Is 


- -1 
a - K L z. 


The  ML  estimator  Is  consistent,  unbiased,  efficient,  and  minimum  varl- 

A A 

ance  unbiased.  The  ML  equation  for  c and  are 


c - K E Re  “ 0 

1 1 
k“l 


E Re  J z,  e » 

k-i  " * “ 


The  corresponding  Ml.  estimates  are 


~ \ Z z J 


- arg  E z. 


These  estimates  are,  of  course,  simply  c - la|  and  41  “ arg  a.  However 
(42)  and  (43)  have  been  presented  because  they  enable  us  to  quickly 
determine  whether  or  not  c and  } are  efficient.  It  follows  from  the 
linearity  of  (42)  that  c is  efficient  (see  [6],  p.  73).  In  fact  c 
Is  consistent,  unbiased,  efficient,  and  minimum  variance  unbiased. 

From  the  nonlinearity  of  (43)  in  the  estimate  ^ we  know  that  the  Ml. 
phase  estimator  is  not  efficient  and  that  no  efficient  estimator  of 
phase  exists.  The  estimator  is  consistent.  As  tl)e  discussion  to 
follow  shows,  tlie  MI.  estimator  of  phase  Is  biased.  However,  it  Is 
modulo-2ii  unbiased,  which  Is  tl\e  property  we  want.  The  pli.ise  estimate 
also  obtained  in  [10]  in  a different  way,  is  Illustrated  In  Fig.  4. 

A A A 

Let  C and  ♦ be  the  estimators  corresponding  to  the  estimates  c 
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and  1^.  We  may  write 


.1 


The  Hufficlent  statistic  K 
transformat  iun  between  (C,'P) 

A A 

density  of  C and  ♦ is 


(46) 

K 2 

T Z.  is  N(ce''  ,0  /K) . The  Jacobian  of  the 
k-1  “ K " 

and  K T Z,  is  C.  Therefore  the  joint 
k-1 


R(c,<>) 


cK 

2iio^ 


1 K J(fi,2. 

expt y |ce  ^-ce  | } 


2o 


(47) 


“ exp{-  — ^ [c^  - 2cc  co8(^-(Ji)  + c^]} 

2no^  2a 

n n 

This  result  is  equivalent  to  (9.46)  in  [23,  p.  413]  with  appropriate 
change  of  notation.  In  (47)  It  is  assumed  -it  < ^ < n . On  this  Interval 

A A A 

g(c,^)  is  not  symmetrical  about  and  therefore  the  estimator  ^ is  biased. 
However  we  may  periodically  extend  g(c,^)  outside  [-iT,n]  in  order  to  de- 
fine the  following  density  on(J>-Ttj<^^(ji  + Tt: 

fs(c,$)  , (|>-'ir_<^£(J)  + Tt 

, otherwise 

A A 

On  the  RHS  of  (48)  g(c,ij>)  stands  for  a periodically  extended  version  of 
(47).  Now  g.  (c,^)  la  symmetrical  about  <ti  and  it  is  the  density  of  ^ 
measured  modulo-2Ti  with  respect  to  i|i.  Thas 


8^(c 


■*'1o 


(48) 


* ^ (J+1T  ^ ^ 

/ dc  / (i-<ti)R  (c.(ji)dij  - 0 
0 (j>-n 


(49) 


which  is  the  modulo-2n  unbiasedness  property  that  we  want.  In  (49)  it 
is  understood  that  (p  is  measured  modulo-2iT  with  respect  to  <|>. 
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XI.  The  Vlterbl  Algor ithm 

The  HAP  sequence  esclmaClon  problem  is  stated  in  (29).  Note  Chat 

r,  satisfies  Che  recursion 
k 


fk  ■ ■'k-l  * -2  % P (♦k/*k-l> 


= — Cj^  cos(iPj^-<t)j^)  + in  p((t.j^/(()Q) 


(50) 


The  so-called  path  metric  is 


-J  cos(.^j^-<t.^^)  + in  P(V\-1> 


(51) 


The  maximization  problem  for  obtaining  the  MAP  phase  sequence  may  now 
be  written 


max 


[max 


rK_i  + "T 

a 

n 


(52) 


This  form  leads  to  the  following  observation:  the  maximizing  trajectory 
(call  it  passing  through  (J>j^  on  its  way  to  must  arrive  at 

along  a route  that  maximizes  If  it  did  not  we  could 

retain  replace  with  a different  sequence  to  get 

a larger  value  for  F . It  is  this  observation  which  forms  the  basis  of 
forward  dynamic  problem.  The  Vlterbi  algorithm,  a forward  dynamic  pro- 
gramming algorithm  applied  to  MAP  sequence  estimation  on  finite-state 
convolutional  sequences,  may  be  applied. 

The  trellis  of  Fig.  5 illustrates  how  the  maximization  of  (52)  pro- 
ceeds. Tabulated  values  of  ^te  stored  in  a square  array  (or 

vector  which  is  cyclically  read)  whose  dimensions  depend  upon  how  finely 
the  interval  [-it, it)  is  discretized^.  Call  " x ^ , with 
finite-dimensional  grid  for  which  I®  defined.  That  is, 

See  the  discussion  in  Section  IV. 
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I 


is  assumed  to  take  on  only  the  values  ~ t"! ,2 , . . . ,M,  for  each 

k.  Call  value  of  the  metric  corresponding  to  a phase 

trajectory  W j which  terminates  at  phase-state  at  stage  k,  after 

passing  through  stage  C at  stage  k-1. 

m 

The  algorithm  begins  with  a computation  of  i“lt2,...,M 

based  on  measured  values  of  c^  and  See  (30).  If  all  phase  values 

are  equally  likely  a priori,  then  in  is  constant  on  all  values 

Otherwise  there  is  some  a priori  weighting  in  favor  of  some  of  the 

t..  A new  measurement  pair  (co,i|/o)  is  obtained  at  k“2  and  rT(^,,C  ) is 
t z i ii  X m 

computed  for  m"l,2,...,M  using  a table  look-up  (e.g.  in  ROM)  for  the 

)•  The  maximum  value  of  r»(C,.^  ) is  determined  (the  maxi- 
ziim  ^im 

mization  is  over  all  originating  states  C ) and  the  corresponding  se- 

ID 

A ^ 

quence  saved  as  a eurvxvor  sequence  terminating  at  at 

stage  2;  denotes  the  originating  state.  The  survivor  sequence  is 
labelled  with  its  corresponding  length  r2(Cj.C2)*  This  calculation  is 
repeated  for  each  possible  value  of  phase  until  all  pairs  (Cj^.C^).  and 
corresponding  lengths  i“l,2,...,M,  have  been  computed  and 

stored  in  soft  memory  (e.g.  RAM).  There  is  a unique  survivor  sequence 

corresponding  to  each  state  ll«l,2 , . . . ,M.  Cautioti:  In  the  pair 

A A A A 

the  originating  state  depends  on  i.e.,  - Cj(Cj).  The 

measurements  c^  and  ii>2  may  now  be  discarded  along  with  all  extinct  se- 
quences. Now  a new  measurement  pair  is  obtained  and  ^3(^2^ 

is  computed  for  m • 1,2,...,M  using  the  recursion  for  F^^  and  a table 

look-up  for  P(<p~^C,  )•  The  maximizing  value  of  r,(C,,Co).  call  it 

j X 4 m j X *. 

A A 

^3^^1’^1^  is  computed  and  the  corresponding  triple  (Cj.Cj^.O  is  stored 
as  a survivor  sequence  originating  in  (*)  at  stage  1,  passing  through 
at  stage  2,  and  terminating  in  at  stage  3.  This  procedure  is 
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repeated  until  M survivor  sequences  of  the  form  are  determined 

and  stored  with  their  respective  survivor  metrics  ^ 
measurements  and  all  extinct  sequences  may  be  discarded. 

A A A 

Call  (t  j(k)  ,l(•2  (k) , . . . ) the  MAP  sequence  based  on  k measurements 

up  to  stage  k.  This  sequence  has  the  maximum  value  of  The  paren- 

thetical notation  (k)  denotes  dependence  on  measurement  interval.  In 
general  the  MAP  sequence  estimate,  (^^^(k+l)  , . . . ,^j^^j^(k+l) , based  on 
measurements  up  to  stage  k+1,  may  differ  from  the  previous  sequence  esti- 
mate at  every  stage  from  1 to  k.  However,  as  a practical  matter,  one  can 
choose  a sufficiently  large  depth  parameter  k^  so  that  the  sequence  of 
fixed-lag  estimates 


k - k^+l , kQ+2 , . . . 


(53) 


gives  an  approximate  MAP  sequence  estimate.  Here  . (k)  is  simply 

x-kQ 

the  phase  value,  kQ  stages  back,  in  the  MAP  sequence  estimate  based  on 
k measurements.  In  this  way  one  obtains  a phase  track  with  delay  k^. 

Following  Forney  []5]  we  may  summarize  the  storage  and  computational 
requirements  for  the  phase  tracking  algorithm  as  follows: 

Storage 


k 


(time  index) 


(Cj .•»•••) ,i“l, 2, ... ,M  (survivor  phase  sequence  terminating 

In  at  stage  k) 

— )|i“1.2, . . . ,M  (survivor  metric) 


P(5»/C  ),«-! M 

t m 

m*!,...  M 


(transition  probability  matrix) 


Initialization 
k - 1 

ri(Cj.Cj^)  - in  P(^i-Cjj/^o)  + 2c^  cos(it.j-tj^),  i-1,2 M 

2o 

n 
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Recursion 


+ — 2 k+1  ^"1*2,. ...M 


^ 

*in 


Measurement / Computation 


Cj^  C08(Cj-^^)  + in 


envelope 

phase 

path  metric 


In  Fig.  5 typical  trajectories  for  this  algorithm  are  Illustrated. 
The  heavy  lines  denote  survivors  and  the  light  lines  denote  path  metric 
calculations  that  are  made  and  then  discarded  in  favor  of  survivors.  At 
stage  3 all  calculations  ) are  Illustrated  with  light  lines;  the 

heavy  line  from  ^2  that  this  path  gives  maximum 

•N 

FifCokC  ) and  is  therefore  labelled  a survivor.  Of  course  C„  ••  C..  The 
/ z m z -) 

x's  on  the  trellis  illustrate  sequences  that  have  survived  for  a while 
before  being  exterminated  by  the  weight  of  evidence.  The  very  heavy 
line  at  each  measurement  stage  k denotes  the  current  MAP  sequence.  The 
circled  numbers  denote  the  current  MAP  sequence.  The  sequence  of  end 
points  labelled  with  the  circled  numbers  is  a sequence  of  pfhuu'  , lU 
Note  this  ('f  differs  from  the  MAP 

efitinatf’.  The  latter,  being  a smoothing  solution,  is  In  fact  generally 


smoother  than  the  former. 


XII.  Illuatrative  Simulations 

In  the  simulationi.;  described  here  the  phase  space  (-11,11)  has  been 
discretized  to  M points  ■ llv/H  - (M-l)it/M,  £“1,2, . . . ,M.  In  Figures 
f>  and  1,  M"ll.  In  Figure  8,  M-17.  The  conditional  probabilities  between 
states  have  been  approximated  with  the  normalized  version  of  (8)  discussed 

i 

in  Section  IV.  These  values  have  been  stored  in  an  MxM  matrix  (really  an  j 

i 

M-vector  which  is  cyclically  permuted  to  generate  the  rows  of  the  Toeplltz  j 

transition  matrix)  and  used  to  calculate  path  metrics  according  to  (51).  | 

L 

A random  walk  phase  sequence  was  generated  from  (26)  and  used  to  f 

construct  a sequence  of  measurements  according  to  (25).  The  measurements  p 

I 

were  then  used  in  the  dynamic  programming  algorithm  of  Section  XI  to  | 

generate  the  results  of  Figures  b-8. 

2 

Fig.  6 is  a relatively  high  signal-noise  ratio  example  where  -0.1 

2 2 

(S/N  ” lOdB) . The  phase  variance  parameter  is  o - (ir/lo/2)  , correspond- 

w 

ing  to  a phase  trajectory  whose  "l-o  transitions"  are  on  the  order  of  ii/14. 

In  Fig.  6 the  solid  curve  with  piecewise  constant  slopes  is  the  actual 
phase  sequence  The  dotted  curve  with  piecewise  constant  slopes 

is  the  measurement  sequence  with  ■ arg  z^  ef-n.n).  The  heavy  lines 

labelled  with  numbers  from  1 to  37  are  MAP  phase  sequences^  generated  with 
the  Vlterbl  algorltlim  of  Section  XI.  The  MAP  sequence  after  k measure- 
ments is  labelled  with  the  corresponding  k value  at  the  end  of  the  sequence. 

Note  in  the  Figure  that  the  maximum  number  of  phase  corrections  to  a path 
is  4,  occurring  at  measurement  9.  There  is  a correction  of  3 phase  values 
at  measurement  27,  In  a region  of  very  noisy  measurements.  Thus  for  this 

^Of  course  these  are  nut  really  MAP  sequences  because  of  the  approximations 
inherent  in  our  discretization  of  the  phase  space.  But  It  Is  cumberson  and 
confusing  to  continually  refer  to  the  sequences  as  iipprwvifrhtti'  MAP  sequences. 
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r 


simulation  one  could  have  decoded  the  MAP  sequence  corresponding  to  37 
measurements  by  decoding  with  a fixed  delay  (or  depth  constant)  of  • 4. 
See  the  discussion  surrounding  (53). 

2 

Fig,  7 shows  a simulation  for  o - 0.3,  corresponding  to  a signal- 

n 

noise  ratio  of  -3dB.  The  phase  sequence  Is  somewhat  more  wildly 

2 2 

fluctuating  than  in  the  previous  case:  ■ (n/lO)  . The  measurement 

sequence  is  really  not  underbiased  as  it  appears  to  be.  Noisy  measure- 
ments on  a phase  sequence  that  hugs  the  upper  boundary  of  [-x.n)  are 
bound  to  appear  underbiased  because  of  the  way  th?  measurement  “ arg  Zy^ 
e[-n,TT)  is  computed.  Several  measurements  in  the  vicinity  of  k - 28-39 
are  reflected  upward  by  2it  to  further  clarify  this  point. 

The  simulation  of  Fig.  7 illustrates  how  the  Vlterbl  tracker  acquires 
phase  at  low  signal-noise  ratios.  Note  that  early  on  in  the  run  Che 
algorithm  jumps  wildly  between  the  phase  points  1 (at  k“l),  11  (at  k**2), 

9 (at  k«3,4),...6  (at  k^S) , and  so  on.  Furthermore,  the  MAP  trajectories 
in  this  phase  acquisition  region  are  constant  phase  trajectories  that 
have  high  a priori  probability;  i.e.,  the  transition  from  (Jij^  ■ to 

is  more  probable  than  any  other.  It  should  also  be  noted  that 
the  MAP  sequences  at  k“21-24  are  actually  quite  good  - the  modulo-2Ti  errors 
between  Che  sequence  values  and  the  actual  phase  are  small.  Finally,  note 
that  for  k“25  and  26  the  algorithm  has  been  diverted  from  the  actual  phase 
by  a sequence  of  unusually  noisy  measurements.  Hy  measurement  k“27  this 
situation  has  been  recognized  .and  a new  trajectory  that  Is  constant 
through  Che  period  of  noisy  measurements  has  been  constructed.  This 
behavior  is  char.acterlstlc  of  the  algorithm  and  is.  In  fact,  one  of  the 


very  nice  features  of  the  algorithm. 
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f 
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Fig.  8 illustrates  how  the  algorithm  operates  on  wild  phase  sequences 

that  make  excursions  outside  the  Interval  [-«,«).  For  this  example  the 

2 2 

phase  variance  parameter  Is  large  : ■ (n/5)  . In  the  course  of  45 

sampling  instants  the  actual  phase  sequence  wanders  over  a range  of 

3it  radians.  For  clarity  of  presentation  phase  values  lying  outside  (-I'.n) 
have  been  reflected  inside  so  that  performance  of  the  modulo-2x  phase 
tracker  may  be  correctly  gauged.  If  loss  of  phase  lock  Is  defined  to  be 
a phase  error  of  n radians,  then  none  occur.  If  It  Is  defined  to  be  fl/2, 
then  2 occur  In  the  vicinity  of  k“25.  In  a region  of  very  wild  phase 
fluctuations. 


31 


XIII.  The  Phase  Locked  Loop  and  Kalman  Filter  Performance  Bounds 

The  phase  locked  loop  (PLL)  for  the  discrete-time  problem  posed  in 
(25)  is  110) 

-ik 


♦k  “ ♦k-l  \ ^ 


■ Vi  * '■•k 


(54) 


Here  denotes  an  estimate  of  the  phase  based  on  measurements 

The  result  of  (54),  illustrated  in  Figure  9,  may  be  interpreted  as  an 

2 2 ^ 

extended  Kalman  filter  with  measurement  dependent  gain  Kj^  ■ 

As  with  the  MAP  sequence  estimate  of  Sections  IX-XI,  data  is  given  more 
weight  for  large  values  of  the  envelope  than  for  small  values.  A 
probabilistic  justification  goes  as  follows.  The  conditional  density  of 
the  phase  statistic  given 


® * ’n'^k 


This  density  is  symmetric  about  so  that 


(55) 


^'V'k>  ■ ♦k 


(56) 


where  the  expectation  is  a "modulo-2n  expectation".  See  the  discussion 
of  Section  X.  The  moduJo-2n  conditional  variance  of  denoted  var [ ) , 
mav  be  numerically  evaluated.  The  result  Is  |i  lot  ted  In  Figure  10.  The 
important  asymptotic  results  are 
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v.r|T^/c_l  . I 


Tt  /3 


6 0 


(57) 


Thus  the  conditional  variance  of  the  roodulo-2n  uiihiaaed  phase  statistic 

2 

y,  is  small  for  larvc  values  of  c,  /o  . This  lustlfles  heavy  weichtlng 
k k n 

of  new  me.isurements. 

The  performance  of  the  PLL  may  be  analyzed  by  appealing  to  a known 

result  obtained  by  Vlterbl  for  a related  continuous- time  problem.  Under 

2 2 

the  condlton  that  a /o  <0.01,  the  result  is  that  the  steady-state  error 
w n — 

performance  for  the  PLL  is  well-approximated  by  [10] 


Tl 

/ X 


-x 


2^  ^0  )exp(r  cos  x)  dx 


(58) 


(oV)’’ 

w n 


The  asymptotics  are 
2 


■c 


n /3 


(59) 


, r -*•  0 

Thus  the  performance  of  the  PLL  follows  the  same  curve  as  the  condi- 
tional variance  of  with  8 replaced  by  r.  See  Figure  10.  At  high 

2 

input  signal-noise  ratio  (o^  <<  1 and  3 <<  1)  the  variance  of  is 

2 2 *5 

approximately  8;  the  variance  of  the  PLL  estimate  is  • Thus  the 

ijaift  of  the  PLL  is  the  ratio  of  these  variances. 


G - c.  (o^/o^)'’ 
k w n 


(bO) 


which  is,  of  course,  the  weighting  applied  to  the  error  term  8in(i|i|^-iJ'l^) 
in  (54). 


To  pursue  this  analysis  further  we  note  that  when  <<  1,  will 
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be  near  unity  with  high  probability  and  8in(^j^-^j^)  will  be  well-approxi- 
mated by  thia  so-called  linear  region  of  operation  the  PLL 
performs  as  if  it  were  forming  the  estimates 


(61) 


As  we  now  show  this  is  approximately  the  Kalman  filter  for  a linear 
2 2 

problem  when  a /a  <0.01. 

w n — 

Consider  the  linear  problem 
■■  \ ■■ 


(62) 


W.  ; W,  : N(0,o  ) 

k k-1  k k w 


The  steady-state  Kalman  filter  for  this  problem  is 


♦k  ■ ♦k-i  * (♦k-*k-i> 


(63) 


2 2 2 
where  o is  the  steady-state  filtering  error  and  o /o^  is  the  Kalman 

gain.  This  error  is  easily  shown  to  be 

2 2,1^  1,,^,  2,  2.is, 

“ '’w^-  2 1 

2 2 'i  2 

The  filtering  error  is  plotted  versus  (o  o ) for  several  values  of  o 

V n w 

2 2 2 

in  Figure  11.  Note  that  when  a /o  < O.OL  o is  well-approximated  by 

w n — 


(64) 


(65) 


2 2 ^ 

and  the  Kalman  gain  is  just  as  in  (61).  This  means  that 

2 2 2 

under  the  assumptions  a /a  <0.01  ixnd  o 1»  the  PLL  is  essentially 

w n ~ n 

2 2 2 W 

a Kalman  filter  whose  estimated  phase  variance  is  o ••  (o  o ) . There- 

w n 

fore  the  curves  outlining  the  hatched  region  of  Figure  11  nicely  bound 

2 2 

achievable  performance  for  a PLL  when  o /o  < 0.01,  and  the  most 

w n 


...  . -u..!  :«v^- ... 
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natural  way  of  presenting  performance  curves  Is  to  plot  them  versus 

2 2 S 2 2 

(o  0 ) . The  assumption  o /o  0.01  is  made  in  all  current  literature 
w n w n — 

on  discrete-time  phase  tracking,  so  all  performance  results  lie  in  the 

hatched  region.  This  region  corresponds  to  low  signal-noise  ratios  and 

sli>wly  fluctu.it  ing  ph.ise  sequences. 

2 2 2 

At  all  values  of  o^/o  and  o*"  the  Kalnvin  filter  performance  results 
w n n 

of  (64)  and  Figure  11  lower  bound  the  achievable  performance  for  a PLL 

or  any  other  filtering  structure,  nonlinear  or  not.  In  Section  XIV  we 

present  perfortiuince  results  for  problems  in  which  these  curves  are  the 

appropriate  bounding  curves.  It  must  be  remembered  when  interpreting 

2 2 S 

results  that  a given  value  of  r • corresponds  to  a smaller  value 

2 2 2 

of  o (and  higher  signal-noise  ratio)  when  o /o  > 0.01  than  when 
n w n 

o^/o^  < 0.01. 

w n — 
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XIV.  Performance  Reaulta  and  Comparisons  with  Other  Nonlinear  Trackers 

The  phase  space  [-n.w)  has  been  discretized  to  M-11  equally-spaced 
points  and  the  Viterbi  algorithm  for  phase  tracking  implemented  as  out- 
lined in  Section  XI.  The  crucial  conditional  probabilities  P I'^i^ 

have  been  computed  as  outlined  in  Section  IV  and  stored  in  an  M vector 
for  cyclic  reading.  Random  phase  trajectories  and  measurement  variables 
have  been  generated  according  to  (25)  and  (26).  The  results  of  several 
Monte-Carlo  simulations  are  presented  in  TABLE  I and  Figures  12  and  13. 

Each  Monte-Carlo  result  has  been  obtained  by  running  the  Viterbi  phase 
tracker  (and  the  PLL)  over  40  different  trajectories,  each  trajectory 
beginning  with  a uniformly-distributed  phase  variable  at  k-1  and  continu- 
ing for  500  points.  Various  values  of  depth  parameter  k^  have  been  used, 
as  indicated  in  the  figures.  Refer  to  [10]  for  a discussion  of  correspond- 
ing statistical  sampling  errors. 

All  simulations  have  been  run  on  a UNIVAC  1110.  The  run  time  for  a 
Monte-Carlo  experiment  consisting  of  20,000  points  is  66  sec.,  a figure 
that  includes  computation  of  Monte-Carlo  statistics  but  excludes  a fixed 
compilation  time  of  28  sec.  for  the  program.  The  number  of  estinuites  per 
second  produced  by  the  algorithm  is  approximately  300/sec.,  making  the 
algorithm  150  times  faster  than  the  PMF  of  [10]  and  approximately  20 
times  faster  than  the  Fourier  implementation  of  the  PMF  reported  in  [13]. 

TABLE  I shows  numerical  results  for  the  sample  filtering  variance 
2 

in  rad  for  the  Viterbi  phase  tracker.  For  all  entries  the  depth  con- 
stant was  kg^lO,  meaning  the  filter  ran  as  a fixed  lag  smoother  with  a 

2 

lag  of  10  samples.  Each  Monte-Carlo  result  for  o was  obtained  from 
20,000  estimates  of  phase. 

In  Figure  12  Monte-Carlo  simulation  results  for  the  Viterbi  tracker 
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are  presented  for  the  pararaetr l/.at ions  commonly  considered  In  the  litera- 
ture. The  results  arc  compared  with  the  PMF  [10],  the  FCF  [9],  the  LQF 
[11],  and  the  GSF  [15].  Also  shown  are  our  simulation  results  for  the 
PLL.  These  results  are  presented  to  legitimize  the  simulation.  For  a 
depth  constant  of  ^^“10  the  Vlterbi  tracker  outperforms  the  PMF  by  approxi- 
mately 0.5  dB  at  r-1.0  (OdB).  Furthermore  the  Viterbi  tracker  makes  up 

I 

more  than  1.0  of  the  2.0  dB  performance  gap  between  the  PLL  and  an  ideal- 

i 

Ized  linear  tracker.  In  terms  of  rms  phase  error  (in  radians),  the  j 

comparison  between  the  PLL  and  the  Vlterbi  tracker  goes  as  follows.  The 
PLL  has  an  rms  phase  error  of  1.26  rad  at  r-1.0.  The  maximum  achievable 
percentage  Improvement  is  21%,  corresponding  to  an  ideal  filter  wltli  rms  t 

phase  error  of  1.0  rad.  The  rms  error  for  the  Viterbi  tracker  operating 
at  r"1.0  with  h^“10  is  1.12.  This  represents  an  Improvement  of  11%  over 
the  PLL.  The  results  for  ^^^“0  show  that  (as  expected)  the  Vlterbi  tracker 
Is  not  as  good  ns  a PLL  as  a zero-lag  filter.  In  Figure  12  the  lieavy 
squares  denoted  by  VT(MAP)  (see  the  symbol  key)  correspond  to  the  smooth- 
ing variance  achieved  when  the  MAP  sequence  for  a 500  sample  run  Is  used 
as  the  phase  estimate.  The  results  are  averaged  over  40  such  runs.  The 
tabulated  results  in  Figure  12  summarize  the  performance  characteristics 
of  many  different  nonlinear  phase  trackers.  In  the  Figure,  perf»>rmance 
results  for  the  Vlterbi  tracker  are  plotted  Just  to  the  left  of  their 
true  positions  to  avoid  cluttering  the  presentation. 

Figure  13  contains  Monte-Carlo  performance  results  for  parameter 
cases  not  usually  considered.  These  results,  generally  corres|ion<l  lug 
to  high  signal-noise  ratio  and  rapidly  varying  phase  cases,  may  be  of 


interest  in  data  communications  applications  where  phase  jitter  Is  .i 
serious  problem.  The  results  of  Figure  13  show  the  Kalman  filter 


performance  bounds  Co  be  useful  as  fairly  tight  lower  bounds  on  observed 

2 2 

performance.  At  o - 0.10  (lOdB  signal-noise  ratio),  and  o ••  1.0,  in 
n w 

which  case  the  PLL  Is  unstable,  the  Viterbi  trucker  performs  within  1 dB 

I 

of  an  idealized  linear  tracker.  See  the  black  squares  at  r • -SdB.  At 

2 2 

o “ 1.0  (0  dB  signal-noise  ratio),  and  a ■ 0.10,  the  Viterbi  tracker 
n w 

achieves  essentially  ideal  performance  for  k^  ••  10  while  outperforming 

the  PLL  by  slightly  more  than  2 dB.  See  the  white  squares  at  r - -5dB. 

2 2 

Similar  performance  Interpretations  hold  for  ■ 1.0  when  ■ 0.01  and 
2 

0 " 1.0.  In  the  latter  case  the  PLL  is  outperformed  by  about  JdB. 

w 

We  hasten  to  emphasize  in  the  interest  of  fairplay  that  all  results 
presented  here  for  non-zero  k^  are  in  reality  smoothing  solutions.  Such 
solutions  are  expected  to  outperform  filtering  solutions.  This  does  not 
detract  from  the  fixed  lag  Viterbi  tracker  as  an  attractive  alternative 
in  those  applications  where  a short  delay  may  be  accepted  in  exchange 
for  1-3  dB  performance  gains. 
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XV . Applications  to  Data  Communication 
An  appropriate  nnadlf Icatlon  of  (25)  to  model  data  communication 
over  a perfectly  equalized  channel  is 


Z 


k 


(6b) 


Here  (Ij^)  may  be  a sequence  of  binary  of  M-ary  source  symbols  which  nuiy 
or  may  not  have  been  trellis  or  convolutional  encoded.  In  the  simplest 
case  is  an  uncoded  sequence  of  independent  source  symbols  drawn 

from  an  equiprobable  symbol  alphabet. 

To  model  data  transmission  over  an  imperfectly  equalized  channel 
with  finite-length  pulse  response  we  proceed  as  follows.  Let  denote 
the  following  (L+1)  - tuple  of  phased  symbols: 

X^  - (1^  e I^_j  e “ ^ l^_j^  e ^)  (67) 

Denote  by  r'  the  finite  pulse  response  of  the  channel: 

r'  - (r^,  r^ r^^)  (68) 

In  these  definitions  the  superscript  ' denotes  transposition. 

The  noisy,  complex  demodulated  channel  output  at  time  k may  be 
written 

In  the  discussion  below  we  present  two  examples  requiring  succes- 
sively higher  levels  of  complexity  for  simultaneous  phase  tracking  and 
symbol  decoding.  Tlie  principle  of  optinvillty  chosen  in  these  examples 
is  MA}’  Jtilti  a. ,';U  trut  i<'}i.  No  claim  of  mlnlm\im 

symbol  error  probability  or  minimum  block  error  probability  is  made. 

Example  1:  is  a sequence  of  independent  symbols  drawn  from 

an  M symbol  complex  alphabet  and  : ransmltt  ed  t>ver  a pejrfoj.'l  ly  eqvi.iUzed 
channel.  This  example  includes  such  modulation  schemes  as  M-ary  ASK, 
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PSK,  QASK,  etc.  The  number  of  candidate  message  sequences  after  K 

K 

symboling  periods  is  M . 

The  appropriate  log  density  function  for  this  example  i.s 
log 

- log  * 

-C+-^  I IvV  ' ^ ^ log 

2o  k»l  k«l 

n 

It  follows  easily  that  the  path  metric  is 


- TT  l‘k  - 'k  ' “1^  ^ '■>«  "‘Wi* 

zo 

n 

This  may  be  written  (ignoring  terms  independent  of  Ij^) 

^ 2Re  ij  e ^ \l^\^  + log 

2o  2o 

n n 

An  even  more  explicit  form  of  the  path  metric  is 

-h  ^ % l^k'  p<Wi> 


where  envelope  and  phase  variables  defined  previously 

and  |lj^|  and  0j^  are  the  magnitude  and  phase  (usually  visualized  In  a 
complex  signal  constellation)  of  the  complex  symbol  From  all  three 

of  the  forms  for  the  path  metric  it  is  clear  that  one  is  attempting  to 

* 

reconstruct  phase-corrected  symbols  e that  correlate  well  with  the 


'This  is  actually  a mixed  density-probability  mass  function.  However 

K -K 

because  the  probability  mass  function  for  assigns  uniform  mass  M 

to  each  K-tuple  Ignore  this  term  and  call  f (•,',*)  a density. 
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received  data  while  also  satisfying  a smoothness  constraint  (as  embodied 
in  the  mod-2ii  phase  sequence. 

The  appropriate  trellis  for  Viterbl  decoding  of  the  modulo-2  pha.se 
sequence  utul  the  symbol  sequence  Is  the  MxM  symbol-phase  trellis  of  pairs 

(l"*.Cg),  m-1.2 M.  t-1.2 M.  corresponding  to  all  allowable  pairs 

of  symbol  and  phase.  Recall  M denotes  the  number  of  phase  points  in  the 
discretized  modulo-2ii  phase  space.  If  Ij^  is  drawn  from  a binary  alphabet 
for  all  k,  then  the  symbol-phase  trellis  simply  consists  of  2M  symbol- 
phase  pairs  over  which  survivor  sequences  are  formed  as  outlined  in 
Section  VI. 

Example  2:  ® sequence  of  independent  symbols  drawn  from  an  M 

symbol  complex  alphabet  and  transmitted  over  a channel  with  finit _p.ulj?j.' 
response  this  example  the  appropriate  log-density  for  ttie  K 

measurements  is  (neglecting  uninteresting  constants) 

log  £((g,)J.  - 

(74) 

2o  k"l  k-1 

n 

Recall  depends  on  a specific  set  of  source  symbols  and  phases  as  In 
(67).  If  the  modulo  2n  phase  space  [-n.n)  is  discretized  to  M values 
then  there  are  (MxM)''^^  distlitct  vectors  .X^^. 

The  path  matrlc  for  this  problem  Is  simply 

2o 

The  trellis  for  Viterbl  decoding  consists  of  the  (HxM)*'^*  allowable  X- 
vectors  correspondli\g  to  (MxM)*'^*  distiiu  t ph.ise-svmbol  si  i lugs 
of  length  L+l . The  path  metric  for  each  transition  In  this 


r 


trellis  is  computed  as  In  (75)  and  used  to  construct  survivor  sequences. 

Of  course,  not  all  transitions  are  allowable  because  specification  of 

(I, , I I.  , ) restricts  the  next  allowable  sequence  to  one  of 

k k-1  k-L 

M sequences  beginning  with  terminating  in  through 

This  means  one  must  store  survivors  and  compute  path  metrics  for 

X allowable  transitions. 
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XVI . ConcluBlons 

We  have  derived  a Viterbl  algorithm  for  obtaining  approximate  MAP 
phase  sequence  estimates  on  1-",’').  The  algorithm  is  simple  and  fast 
by  nonlinear  filtering  standards,  and  ideally  organized  for  hardware 
implementation.  Performance  is  superior  to  that  of  existing  structures 
for  moderate  values  of  filtering  delay,  making  the  approach  attractive 
in  applications  where  delay  is  acceptable. 


Brr 


J 


43 


Acknowledgments 

The  authors  acknowledge  the  support  of  J.  Lord,  R.  McGough,  and 
B.  Plcinbono.  0.  Macchl  is  acknowledged  for  her  helpful  discussion 
and  for  her  critique  of  the  manuscript.  C.  Pariente  conducted  the 
Monte-Carlo  simulations  at  the  University  of  Paris-Sud,  using  software 
originally  developed  by  CJM. 


References 

[1]  F.  Lehan  and  R.  Parks,  "Optimum  Demodulation,"  IRE  National  Con- 
vention Record,  part  8,  pp.  101-103  (1953). 

[2]  D.  C.  Youla,  "The  Use  of  Maximum  Likelihood  in  Estimating  Continu- 
ously Modulated  Intelligence  Wlilch  Has  Been  Corrupted  by  Noise," 

IRE  Trans.  Inform.  Theory,  IT- 3,  pp.  90-105  (March  1954). 

[3]  R.  Bellman,  Invariant  Imbedding.  Academic  Press,  N.Y.  (1964). 

[4]  D.  M.  Detchmendy  and  R.  Sridhar,  "Sequential  Estimation  of  States 
and  Parameters  In  Noisy  Dynamical  Systems,"  ASME  J.  Basic  Eng.  , 
pp.  362-368  (June  1966). 

[5]  A.  B.  Baggeroer,  "Nonlinear  MAP  Interval  Estimation,"  Research 
Laboratory  of  Electronics,  MIT,  Cambridge,  MA,  QPR  No.  85,  pp.  249- 
253  (April  1967). 

[6]  H.  L.  Van  Trees,  Detection,  Estimation,  and  Modulation  Theory, 

Part  II,  N.Y.:  Wiley  (1971),  Ch.  7. 

[7]  H.  J.  Kushner,  "On  the  Differential  Equations  Satisfied  by  Condi- 
tional Probability  Densities  of  Markov  Processes,  with  Applications," 
J.  SIAM  Control,  Ser.  A,  2,  pp.  106-119  (1964). 

[8]  D.  Snyder,  "The  State  Variable  Approach  to  Continuous  Estimation 
with  Applications  to  Analog  Communication  Theory,"  MIT  Press, 
Cambridge,  MA  (1969). 

[91  A.  S.  Willsky,  "Fourier  Series  and  Estimation  on  the  Circle  with 
Applications  to  Synchronous  Communication  - Part  1:  Analysis," 

IEEE  Trans.  Inform.  Theory,  IT-20,  pp.  577-583  (September  1974). 

[101  R-  S.  Bucy  and  A.  J.  Mall inckrodt , "An  Optimal  Phase  Demodvilator ," 
Stochastics,  pp.  3-23  (1973). 

[Ill  D.  E.  Gustafson  and  J.  L.  Speyer,  "Linear  Minimum  Variance  Filters 
Applied  to  Carrier  Tracking,"  IEEE  Trans,  on  Autom.  Contr. , AC-21 . 
pp.  65-73  (February  1976). 

[121  C.  N.  Kelly  and  S.  C.  Gupta,  "The  Digital  Phase-Locked  Loop  as 
a Near-Optimum  FM  Demodulator,"  IEEE  Trans.  Commun.,  COM-20, 
pp.  406-411  (June  1972). 

[131  R*  S.  Bucy  and  H.  Youssef,  "Fourier  Realization  of  the  Optimal 
Phase  Demodulator,"  Symposium  on  Nonlinear  Estimation  and  Its 
Applications,  San  Diego,  CA  (1973). 

[141  H.  W.  Sorenson  and  D.  L.  Alspach,  "Recursive  Bayesian  Estlnvition 
Using  Gaussian  Sums,"  Automatic,  _7,  pp.  465-479  (1971). 

(151  P.K.S.  Tam  and  J.  B.  Moon-,  "A  Gaussian  Sum  Approach  tt>  Phase  and 
Frequency  Estimation,"  IEEE  Trans.  l\immun. , COM-25 . pp.  935-942 
(September  1977). 


[16]  A.  J.  Vlterbl,  "Error  Bounds  for  Convolutional  Codes  and  An 
Asymptotically  Optimum  Decoding  Algorithm,"  IEEE  Trans.  Inform. 
Theory,  IT-15,  pp.  260-269  (April  1969). 

[17]  C.  R.  Cahn,  "Phase  Tracking  and  Demodulation  with  Delay,"  IEEE 
Trans.  Inform.  Theory,  IT-2Q,  pp.  50-58  (January  197A). 

[18]  G.  Dngerboeck,  "New  Applications  for  the  Vlterbl  Algorithm"  Carrier 
Phase  Tracking  In  Synchronous  Data-Transmisslon  Systems,"  National 
Telecommunications  Conference  (1974). 

[19]  W.  Feller,  Introduction  to  Probability  Theory  and  Its  Applications, 
Vol.  II,  2nd  Edition,  N.Y.:  Wiley  (1966). 

[20]  S.  Karlin  and  H.  Taylor,  "A  First  Course  in  Stochastic  Processes, 

2nd  Edition,  N.Y.:  Academic  Press  (1975). 

[21]  H.  L.  Van  Trees,  Detection,  Estimation,  and  Modulation  Theory,  Part 
1,  N.Y.:  Wiley  (1968),  Ch.  4. 

[22]  C.  P.  Hatsell  and  L.  W.  Nolte,  "Optimal  Detection  of  a Signal  with 
Time-Varying  Carrier  Phase,"  IEEE  Trans,  on  Aerospace  and  Electr. 
Syst.,  AES-10,  pp.  788-794  (November  1974). 

[23]  D.  Middleton,  An  Introduction  to  Statistical  Communication  Theory, 
N.Y.:  McGraw-Hill  (1960). 

[24]  T.  S.  Ferguson,  Mathematical  Statistics;  A Decision  Theoretic 
Approach,  N.Y.:  Academic  Press  (1967). 


I 


I 


I 


I 


I 

! 


Figure  1. 
Figure  2. 
Figure  3. 
Figure  4. 
Figure  5. 

Figure  6. 
Figure  7. 

Figure  8. 

Figure  9. 
Figure  10. 
Figure  11. 
Figure  12. 


TABLE  I. 


46 

List  of  Figures  and  Tables 

Phase  Processes 

Quadrature  Demodulator 

The  Nature  of  the  MAP  Sequence 

The  MAP  Estimate  for  Fixed  Phase  Acquisition 

Phase  Trellis  Illustrating  the  Evolution  of  Surviving 
Phase  Tracks 

Typical  Simulation:  Decoding  a MAP  Sequence 

Typical  Simulation:  Decoding  a Low  S/N-Hlgh  Variance 
Phase  Sequence 

Typical  Simulation:  Decoding  a Low  S/N-Very  High  Variance 
Phase  Sequence 

The  Phase  Locked  Loop  and  a Linearized  Version 

Varl^/c^I  vs.  8 - 

Performance  Bounds 
Performance  Results 

Mean  Square  Modulo-2n  Error:  Monte-Carlo  Results 


i 


i 


■ k 


FlRuro  2.  Quadraturo  Demodiil  at  or 


4 MAf  Phase  Secuence 


Fleire  7.  Typical  Simulation:  Decoding  a Low  S/N-High  Variance  Phase  Sequence 


figure  8.  Typical  Simulation:  Decoding  a Low  S/S~Very  High  Variance  Phase  Sequence 


(b)  Linearized  PLL 


Figure  9.  The  Phase  Locked  Loop  and  a Linearized  Version 


lOlog^  vor  [ 


10  log  <r  ; <r  ! error  variance 


r-(a  o ) 


0.316 

(-5dB) 

0.73 

(-1.35dB) 

1.0 

(OdB) 

1.25 

(0.96dB) 

3.16 

(5dB) 

2.32 

(3.66dB) 

0.10 

(-lOdB) 

0.14 

(-8.7dB) 

0.316 

(-5dB) 

0.23 

(-6.3dB) 

1.0 

(OdB) 

0.90 

(-0.45dB) 

0.032 

(-15dB) 

0.048 

(-13.2dB) 

0.10 

(-lOdB) 

0.079 

(-lldB) 

0.316 

(-5dB) 

0.124 

(-9.1dB) 

2.10 

(3.24dB) 

1.25 

(0.96dB) 

0.63 

(-1.99dB) 

TABLE  I.  Performance  Results  for  Viterbi  Phase  Tracker;  k 


Unclassified 


tCCUNITV  CLASSIFICATION  OF  THIS  NAOt  Oat* 


REPORT  DOCUMENTATION  PAGE 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 


I.  NtNOAT  NUMBIN 

Technical  Report  #27 


>.  COVT  Accession  NO. 


t NCCINICnT'S  CAT  ALOG  NUMSeN 


«.  TITLl  (mm  Subllllt)  t 

Modiilo-2'n  Phase  Sequence  Estimation 


S TVPC  OF  ACPONT  • PCNIOO  COVCNCO 


S PCAFONMINO  ONG.  MCPONT  NUMBIN 
I CON^NACT  OR  GNANT  NUMaenr*! 


T.  AyTMONr*; 

Louis  L.  Scharf 
Dennis  D.  Cox 
C.  Johan  Masrellez 


N00014-75-C-0518 


10  PNOGNAM  CLeMtNT.  PNOJICT,  TASK 
ANCA  • NONK  unit  NUMBCNS 


t PtnFONMINO  ONGANIZATION  NAME  ANO  ADOMItS 

Department  of  Electrical  Engineering 
Colorado  State  University  ^ 

Fort  Collins,  CO  80523  / 


• I.  CONTNOLLING  OFFICE  NAME  ANO  AOONESS 

Office  of  Naval  Research 
Statistics  and  Probability  Branch 
Arlington,  VA  22217 


IS.  NEPONT  DATE 

n7» 


IS.  NUMBEN  OF  pages 

59 


1^  MONITORING  AGENCY  NAME  A AOONESS^If  dllttmnl  tram  Canlralllitt  Otfict) 


IS.  SeCUNITV  CLASS.  (•!  IM*  rappNJ 

Unclassified 


Ita  OECL  ASSIFICATION/OONNGNAOING 

schedule 


IS.  distribution  STATEMENT  (ol  ihit  RaporO 


Approved  for  public  release;  distribution  unlimited. 


IT.  DISTNIBUTION  STATEMENT  (ol  Ibo  aSatracI  onlotod  In  Block  SO,  II  Olfloranl  Iron  BaporlJ 


IB.  supplementary  NOTES 

; ^ 

V 


/ 


V 


Tr’nriT^ioitDsTcooiinuo'orrraooraaTidaTf'iiiaeoMMr'arioidamliykfkioekrwsir; 

MAP  sequence  estimation;  nonlinear  filtering,  phase  estimation,  dyniimlc 
progTamming,  Viterbi  algorithm,  estimation  of  random  walk 


JO.  ABSTliACT  (CanllniM  an  rovacao  alBa  II  nacaoaarr  and  Idmtilfr  *»  Hock  nwAarj 

'^he  probabilistic  evolution  of  random  walk  on  the  circle  is  studied  and 
the  results  used  to  derive  a MAP  sequence  estimator  for  phase.  The  sequence 
estlmato^  is  a Viterbi  tracker  for  tracking  phase  on  a finite-dimensional  grid 
in  [-K*).  The  algorithm  is  shown  to  provide  a convenient  method  for  obtaining 
fixed-lag  phase  sequence  estimates.  Performance  characteristics  are  presented 
and  compared  with  several  other  nonlinear  filtering  algorithms.  The  results 
indicate  superior  performance  over  the  range  of  parameter  values  usually  con- 
sidered  and  excellent 


T' 

Unclassified 

tECUNiTV  cl AttiFiCATiON  OF  TNII  PAGE  (^m<  Dim  Snimbd) 


DO  1^ 


"S:  n 1473 


edition  of  I NOV  El  IS  OBSOLETE 
S/N  OIO]-AI4<EEOI  I 


r 


1 


I 


Unclassified 


■.LcurnTy  cuAi8iric*TioN  or  this  Pi>ctf<w>«n  pk  KititmQ 


signal-to-noise  ratio  and  rapidly  fluctuating  phase.  Applications  to 
coherent  data  communication  systems  are  outlined. 


Unclassified 


SfCuSlTy  CLAtliriCATION  OF  TMIl  rACCfWiw.  Omtm  Enfnd) 


